Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(No need to review) Testing google_cloud_bigtable 2.25.2 with Beam 2.49.0 #28597

Conversation

burkedavison
Copy link
Contributor

Do not merge.

Updating google_cloud_bigtable to 2.25.2 to test against Beam 2.49.0.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@codecov
Copy link

codecov bot commented Sep 21, 2023

Codecov Report

Merging #28597 (752854b) into release-2.49.0 (6ce85e5) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@                Coverage Diff                 @@
##           release-2.49.0   #28597      +/-   ##
==================================================
- Coverage           71.50%   71.50%   -0.01%     
==================================================
  Files                 858      858              
  Lines              104806   104813       +7     
==================================================
+ Hits                74946    74948       +2     
- Misses              28310    28315       +5     
  Partials             1550     1550              
Flag Coverage Δ
python 80.82% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 8 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Java Tests / Java Unit Tests (ubuntu-latest) failure:

org.apache.beam.fn.harness.logging.BeamFnLoggingClientTest > testClosableWhenBlockingForOnReady FAILED
    java.lang.AssertionError at BeamFnLoggingClientTest.java:446

Java Tests / Java Unit Tests (windows-latest)

org.apache.beam.fn.harness.logging.BeamFnLoggingClientTest > testClosableWhenBlockingForOnReady FAILED
    java.lang.AssertionError at BeamFnLoggingClientTest.java:446

Java ("Run Java PreCommit")

18:43:29 Execution failed for task ':sdks:java:io:snowflake:compileJava'.
18:43:29 > Failed to store cache entry 2b3b0d96babb3c50b448068acc361fa2 for task ':sdks:java:io:snowflake:compileJava': Timeout waiting to lock Build cache (/home/jenkins/.gradle/caches/build-cache-1). It is currently in use by another Gradle instance.
...
18:43:29 Execution failed for task ':runners:java-fn-execution:test'.
18:43:29 > Process 'Gradle Test Executor 15' finished with non-zero exit value 143
18:43:29   This problem might be caused by incorrect test process configuration.
Display name in pull request Command in pull request comments Gradle goals Success?
Java SDK Post Commit Tests Run Java Postcommit :sdks:java:io:google-cloud-platform:postCommit Pass
Java_PVR_Flink_Batch Run Java_PVR_Flink_Batch PreCommit :runners:flink:1.13:job-server:validatesPortableRunnerBatch Fail
Java Spark PortableValidatesRunner Batch Tests Run Java Spark PortableValidatesRunner Batch :runners:spark:2:job-server:validatesPortableRunnerBatch, :runners:spark:3:job-server:validatesPortableRunnerBatch Pass
Dataflow V2 Java Post Commit Tests Run PostCommit_Java_DataflowV2 :runners:google-cloud-dataflow-java:validatesRunnerV2 Pass
Google Cloud Dataflow Runner V2 Java ValidatesRunner Tests Run Java Dataflow V2 ValidatesRunner Streaming :runners:google-cloud-dataflow-java:validatesRunnerV2Streaming Fail

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Run Java_PVR_Flink_Batch PreCommit

Test failure:

org.junit.runners.model.TestTimedOutException: test timed out after 1200 seconds
	at java.lang.Thread.sleep(Native Method)
	at org.apache.beam.runners.portability.JobServicePipelineResult.waitForTerminalState(JobServicePipelineResult.java:151)
	at org.apache.beam.runners.portability.JobServicePipelineResult.waitUntilFinish(JobServicePipelineResult.java:116)
	at org.apache.beam.runners.portability.testing.TestPortableRunner.run(TestPortableRunner.java:81)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:321)
	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:398)
	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:335)
	at org.apache.beam.sdk.transforms.WithTimestampsTest.withTimestampsShouldApplyTimestamps(WithTimestampsTest.java:81)

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Run Java Postcommit

Passed

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Run Java Spark PortableValidatesRunner Batch

Passed

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Run PostCommit_Java_DataflowV2

Passed

@burkedavison
Copy link
Contributor Author

burkedavison commented Sep 22, 2023

Run Java Dataflow V2 ValidatesRunner Streaming

https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming_PR/103/


16:43:49 org.apache.beam.sdk.transforms.windowing.WindowTest > testMergingCustomWindowsKeyedCollection FAILED
16:43:49     java.lang.RuntimeException at WindowTest.java:663
17:15:27 
17:15:27 org.apache.beam.sdk.transforms.windowing.WindowingTest > testPartitioningWindowing FAILED
17:15:27     java.lang.RuntimeException at WindowingTest.java:127
17:18:21 
17:18:21 org.apache.beam.sdk.transforms.ViewTest > testListSideInput FAILED
17:18:21     java.lang.RuntimeException at ViewTest.java:361
17:29:02 
17:29:02 org.apache.beam.sdk.transforms.ViewTest > testMapSideInput FAILED
17:29:02     java.lang.RuntimeException at ViewTest.java:1065
17:40:14 
17:40:14 org.apache.beam.sdk.transforms.ViewTest > testWindowedSideInputFixedToFixedWithDefault FAILED
17:40:14     java.lang.RuntimeException at ViewTest.java:1575
17:54:15 
17:54:15 org.apache.beam.sdk.transforms.ViewTest > testWindowedIterableSideInput FAILED
17:54:15     java.lang.RuntimeException at ViewTest.java:562
18:05:40 
18:05:40 org.apache.beam.sdk.transforms.ViewTest > testWindowedMapSideInputWithNonDeterministicKeyCoder FAILED
18:05:40     java.lang.RuntimeException at ViewTest.java:1264
18:16:40 
18:16:40 org.apache.beam.sdk.transforms.ViewTest > testWindowedSideInputFixedToGlobal FAILED
18:16:40     java.lang.RuntimeException at ViewTest.java:1536
18:28:02 
18:28:02 org.apache.beam.sdk.transforms.ViewTest > testMultimapSideInputWithNonDeterministicKeyCoder FAILED
18:28:02     java.lang.RuntimeException at ViewTest.java:770
18:39:37 
18:39:37 org.apache.beam.sdk.transforms.ViewTest > testEmptyMultimapSideInput FAILED
18:39:37     java.lang.RuntimeException at ViewTest.java:950
19:02:30 
19:02:30 org.apache.beam.sdk.transforms.ViewTest > testCombinedMapSideInput FAILED
19:02:30     java.lang.RuntimeException at ViewTest.java:1454
19:13:54 
19:13:54 org.apache.beam.sdk.transforms.ViewTest > testMultimapSideInputIsImmutable FAILED
19:13:54     java.lang.RuntimeException at ViewTest.java:1033
19:25:09 
19:25:09 org.apache.beam.sdk.transforms.ViewTest > testWindowedMultimapAsEntrySetSideInput FAILED
19:25:09     java.lang.RuntimeException at ViewTest.java:867
19:36:42 
19:36:42 org.apache.beam.sdk.transforms.ViewTest > testWindowedMultimapSideInputWithNonDeterministicKeyCoder FAILED
19:36:42     java.lang.RuntimeException at ViewTest.java:917
19:48:11 
19:48:11 org.apache.beam.sdk.transforms.ViewTest > testMapSideInputWithNonDeterministicKeyCoder FAILED
19:48:11     java.lang.RuntimeException at ViewTest.java:1132
19:59:33 
19:59:33 org.apache.beam.sdk.transforms.ViewTest > testWindowedSingletonSideInput FAILED
19:59:33     java.lang.RuntimeException at ViewTest.java:158
20:11:12 
20:11:12 org.apache.beam.sdk.transforms.ViewTest > testWindowedMultimapSideInput FAILED
20:11:12     java.lang.RuntimeException at ViewTest.java:819
20:22:06 
20:22:06 org.apache.beam.sdk.transforms.ViewTest > testSideInputWithNullDefault FAILED
20:22:06     java.lang.RuntimeException at ViewTest.java:1604
20:33:33 
20:33:33 org.apache.beam.sdk.transforms.ViewTest > testWindowedListSideInput FAILED
20:33:33     java.lang.RuntimeException at ViewTest.java:410
20:45:11 
20:45:11 org.apache.beam.sdk.transforms.ViewTest > testWindowedMapSideInput FAILED
20:45:11     java.lang.RuntimeException at ViewTest.java:1176
20:56:30 
20:56:30 org.apache.beam.sdk.transforms.ViewTest > testIterableSideInputIsImmutable FAILED
20:56:30     java.lang.RuntimeException at ViewTest.java:625
21:07:48 
21:07:48 org.apache.beam.sdk.transforms.ViewTest > testListSideInputIsImmutable FAILED
21:07:48     java.lang.RuntimeException at ViewTest.java:488
21:19:18 
21:19:18 org.apache.beam.sdk.transforms.ViewTest > testEmptyListSideInput FAILED
21:19:18     java.lang.RuntimeException at ViewTest.java:439
21:30:50 
21:30:50 org.apache.beam.sdk.transforms.ViewTest > testWindowedSideInputFixedToFixed FAILED
21:30:50     java.lang.RuntimeException at ViewTest.java:1495
21:42:22 
21:42:22 org.apache.beam.sdk.transforms.ViewTest > testIterableSideInput FAILED
21:42:22     java.lang.RuntimeException at ViewTest.java:516
21:53:28 
21:53:28 org.apache.beam.sdk.transforms.ViewTest > testEmptyMultimapSideInputWithNonDeterministicKeyCoder FAILED
21:53:28     java.lang.RuntimeException at ViewTest.java:984

@kennknowles
Copy link
Member

Extracting the stack traces rather than just the boolean failed / not failed will make this easier to diagnose for a passerby like myself.

@burkedavison
Copy link
Contributor Author

Extracting the stack traces rather than just the boolean failed / not failed will make this easier to diagnose for a passerby like myself.

I will certainly try to do that, but the console output only shows what I've already provided and I can't find how to extract more information from the results.

@kennknowles
Copy link
Member

Run Java PreCommit

@kennknowles
Copy link
Member

Run Java_GCP_IO_Direct PreCommit

@kennknowles
Copy link
Member

Run Python_Integration PreCommit

@kennknowles
Copy link
Member

Run SQL PreCommit

@kennknowles
Copy link
Member

The Jenkins UI has browseable test results which will have the details. I like the Gradle Scan UI best, though. It may also be in the console log somewhere up higher, but that's more of a pain to dig through.

@kennknowles
Copy link
Member

Run Java PreCommit

@kennknowles
Copy link
Member

Run Python_Integration PreCommit

@damccorm
Copy link
Contributor

Closing since it looks like this testing process is no longer active. If I'm wrong, feel free to reopen

@damccorm damccorm closed this Oct 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants